Development Of Assessment Instrument Research Articles

Development of hots-based cognitive assessment instruments: ADDIE model

Higher order thinking skills (HOTS) are an important element in facing the challenges of the 21 st-century. Difficulty in solving problems systematically, facing challenges in an organized manner, and being unable to design original solutions are due to the low HOTS that students have. HOTS ability can improve students who low-level thinking skills in several ways, for example, through learning integrated with media, practice, and assessment or HOTS-based cognitive assessment. The purpose of this study was to develop and implement a HOTS-based cognitive assessment to assess students' HOTS abilities. The device development model used is an adaptation of the analysis, design, development, implementation, and evaluation (ADDIE) model. The research sample consisted of 30 students in class 11 of the Governance and Office Automation Competency Program of Vocational High School 1 Kudus. The result is that 11 students have the HOTS ability with very good criteria, 17 well criteria, and 2 enough criteria. This study suggests that a test instrument for further research is to measure students' HOTS ability. The Experts conclude that HOTS-based cognitive assessment can be used as an approach to improve students' HOTS to actively think selectively and supported by logical argumentation.

PENGEMBANGAN BAHAN AJAR MENYIMAK UNTUK SISWA SEKOLAH KEJURUAN

This study was aimed at developing listening material and teaching aid. The teaching aid makes use of computer. The purpose of using computer to help students in order to make the teaching-learning process effective and interesting. In constructing or developing the thesis, R & D method is applied. This method consists of 1) assessing to identify goal, 2) conducting instructional analysis, 3) analyzing learners and contexts, 4) writing performance objective, 5) developing assessment instruments, 6) developing instructional strategy, 7) developing and select instructional materials, 8) designing and conducting formative evaluation of instruction, 9) revising instruction, and 10) designing and conducting summative evaluation. The result of the developmental study shows that the teaching aid is good. It gets 3,75. The students who are involved in this study is the students of vocational high school grade X of tourism program. All of them enjoyed the lesson. It can be concluded that the listening material and teaching aid is effective and hence it is easy to be operated. Keyword: listening material, and teaching aid

Development of Assessment Instruments to Measure Scientific Performance

This research aims to develop a scientific performance assessment instrument in the laboratory in experiment of analyzing the content of a compound in loose powder. The assessment instrument developed is in the form of worksheets and performance assessment sheets and rubrics. The method used in this research is design-based research (DBR) with two stages, namely the analysis stage and product design development. Data collection was carried out by validation tests to expert lecturers and the results were analyzed. The results of the validation test of scientific performance assessment instruments in the form of worksheets obtained a value of rcount = 0.83 and performance assessment sheets rcount = 0.84. This value indicates that both instruments are valid.
 Keywords: development, assessment instruments, science performance

SCIENCE TEACHER ABILITY TO DESIGN STUDENT SPIRITUAL ATTITUDE INSTRUMENTS

Each teacher must be able to harmonize the assessment of cognitive and psychomotor aspects with the assessment of students' affective aspects in learning. Most of the research conducted in Aceh is still limited to the development of spiritual attitude assessment instruments, while studies describing the ability of science teachers to design spiritual attitude assessment instruments are still very limited. This study aims to determine the ability of junior high school science teachers in the Pidie District to prepare questions to measure students' spiritual attitudes. The research uses the Mix method, with documentation and interview analysis techniques using the Miles and Huberman models, and the feasibility validity of the spiritual attitude assessment instrument uses a Likert scale and is then presented using percentage calculations. A purposive sampling technique is applied in determining the sample. The results showed that most of the teachers had less ability to design spiritual attitude assessment instruments. Few teachers could compile a comprehensive spiritual attitude assessment instrument per the attitude assessment technique in the 2013 curriculum. The first obstacle science teachers faced was formulating assessment indicators, where some teachers did not understand spiritual attitudes with social attitudes in learning. Secondly, assessment techniques with Rubik's or scoring guidelines were not in line with the demands of the 2013 curriculum.

Development of higher order thinking skill assessment instruments in social studies learning

<span lang="EN-US">Higher order thinking skill (HOTS) in social studies learning are still often ignored by teachers despite the need for students to acquire these skills. The purpose of this study is to develop her HOTS assessment in a social studies classroom to help teachers improve their students’ thinking skills. This kind of research is research and development with 4D models. Validation was performed by two social studies learning assessment specialists and three social studies teachers. The HOTS test was administered to 112 students in class VIII (second grade) of Yogyakarta junior high school. Data analysis consisted of validity, reliability, difficulty, selectivity, and distractor index. Explanatory factor analysis (EFA) pathway analysis was used for data analysis of small trials and confirmatory factor analysis (CFA) pathway analysis was used for large trials. The multiple-choice HOTS assessment tool consisted of 30 items, and the effectiveness results of this HOTS questions on material, structure, and language aspects by two social studies learning assessment experts where it was valid and suitable for our application. Effective results for three social studies teachers indicated that the assessment tool was valid and applicable. HOTS in social studies learning helps improve quality and learning outcomes, enabling students to examine information critically, develop creativity, and improve problem-solving skills.</span>

Development of Performance Assessment Instruments for Measuring Drawing Skills in Vocational Students Competence in Mechanical Engineering Expertise

Objective: This research aims to develop a performance assessment instrument that can measure Drawing Skills in Machining Engineering Skills Competency Vocational School students, in addition to determining the feasibility and results of testing the performance assessment instrument. Method: This research is development research with a 4D Model, which consists of four stages, namely Defining, Designing, Developing, and Disseminating, and is limited to the development stage only. Results: The results of the research show that the vocational school students' drawing skills instrument for machining engineering skills competency was carried out by validating the contents of the instrument using the content validity ratio (CVR) method. Instrument trials were conducted at State Vocational School 2 Surabaya in the Machining Engineering skills program, totaling thirty-one students. Of the thirty instrument items developed, the test results referred to the CVR, total correlation, OMS, and IMS criteria; two items did not meet the requirements, so these items had to be revised or eliminated. Novelty: This research presents novelty by designing a particular Performance Assessment instrument to measure the drawing skills of vocational school students who have technical drawing competency, especially in the psychomotor aspect, so that it will make it easier for teachers to carry out assessments.

How Development of Assessment Instruments with Quizizz Paper Mode in Procedure Texts: a Discourse Analysis Study

This study addresses the need for more engaging assessment tools in Indonesian language lessons for Class VII students at SMP Negeri 2 Sibolangit. It aims to (1) Explore the process of developing assessment instruments using Quizizz paper mode for procedure text materials, (2) Assess the validity of the Quizizz-assisted assessment instrument, and (3) Evaluate its practicality in classroom settings. Following the Borg and Gall research and development model, the study involves eight stages, from data collection to dissemination. Data analysis combines quantitative insights from questionnaires with qualitative feedback from validators and users. Results indicate high validity ratings from assessment and design experts, alongside strong practicality ratings from educators and students, highlighting the effectiveness of the developed assessment tool. Moreover, the discourse analysis approach provides valuable insights into how the assessment instruments facilitate meaningful interactions and learning experiences in the classroom, suggesting broader implications for curriculum design and pedagogical practices.

Examining the Assessment Practices of Foreign Language Novice Teachers

This paper reports a mixed-methods study at a public university in Colombia. It describes the classroom assessment practices and challenges of 75 novice foreign language teachers. To gather the quantitative data, the participants completed an online survey. For the qualitative data, 11 key informants participated in one-on-one online interviews. Findings revealed that novice teachers predominantly used summative assessment in the classroom and aligned their assessment instruments to large-scale tests. Moreover, novice teachers faced many challenges with classroom assessment, including determining how to assess their students, developing assessment instruments, and interpreting and using assessment scores to inform teaching and learning. In conclusion, novice teachers need more knowledge, skills, and support to handle daily assessment-related tasks.

Teachers’ made writing assessment instrument: Pedagogical insight from process to product

Despite the urgency of assessment instruments in teaching foreign language writing, evidence regarding how teachers develop assessment instruments and maintain their quality, particularly for comparison and contrast essay writing based on a genre-based approach to teachers’ classroom practices, is scantily reported. To address this empirical need, this article showcases how a set of teacher-made assessment instruments for a comparison and contrast essay based on a genre-based approach in a writing essay course at a public university in East Java was carefully and deliberately developed. To attain the research objective, this research enacted design-based research (DBR) inspired by Cavallaro and Sembiante (2021). In addition to content validity, face validity and inter-rater reliability were ensured by involving ten students, three fellow writing teachers, and two trained raters. This assessment instrument development project produces a set of valid formative assessment instruments, comprising a writing prompt and scoring rubric. The inter-rater reliability shows a high degree of positive correlation with a reliability coefficient of 0.862 from a correlational analysis based on Pearson correlation coefficient. This in-practice assessment instrument development can be used as a reference, contributing to the teachers’ assessment literacy development. It also serves as a valuable model for future researchers to develop and expand nested classroom assessment scholarship. A well-structured validity and reliability process of assessment instrument development will practically enhance the teaching practices in the essay writing course in particular and EFL teaching in general.

Development of an Online Project-Based Learning Assessment Instrument for Vocational Education Students

Objectives from the study This is an instrument for reliable online project-based learning assessment for vocational education students. Study This uses 10 procedures for the non-ttest instrument developed by Mardapi. The population study covers the whole Electrical Engineering Education student’s year at the First Faculty of Engineering, Universitas Negeri Padang. The sample consists of the 250 students selected through two stages: the trial stage, which uses the cluster random sampling method, and the stage measurement, which uses the simple random sampling method. Data analysis was performed using validity tests using the Aiken index as well as validity and reliability tests. Findings study These are (1) instruments. The assessment of project-based learning online consists of 30 valid and reliable items, so it can be used by lecturers. (2) Ability to measure cognitive, affective, and psychomotor skills in the learning process Cognitive, affective, and psychomotor vocational education students tend Good.

Separation Anxiety: The Core of Attachment and Separation-Individuation

ABSTRACT This paper, written in honor of Anni Bergman, focuses on the concept of separation anxiety as it was conceptualized and developed in attachment theory by Bowlby and in separation-individuation theory by Mahler and colleagues. The focus is on how separation anxiety manifests differentially in individuals with secure versus insecure attachment and in different subphases of the separation-individuation process, with emphasis on the areas of overlap and divergence in the two traditions. The paper then reviews recent research that has focused on how separation anxiety has provided a transdiagnostic risk factor for psychopathology, including anxiety, depression, and PTSD, complicating the treatment course of individuals with these disorders. These findings have contributed to the delineation of the DSM-5 diagnosis of Separation Anxiety Disorder (SAD) and to the development of new assessment instruments to measure it. We consider how separation anxiety has been assessed in several treatment studies of these disorders and how it is related to other factors such as insecure attachment and reflective function (RF, mentalization in attachment relationships). The ways in which recent research on separation anxiety in individuals with psychopathology, including depression and PTSD, has affirmed and expanded the original formulations of Bowlby and Bergman and her colleagues is also discussed.

Development of assessment instruments on limb and sensory materials based on the BATURADEN word wall application for elementary school students

Assessment activities that are often used by teachers are conventional, namely, students doing written questions and students answering on answer sheets provided by the teacher. Conventional assessment has several disadvantages, namely the cost of procuring paper for doubling questions, less effective and efficient proofreading time, and errors when correcting. The purpose of the study was to develop a word wall-based assessment instrument on Body Parts and Senses material for elementary school students. This research is included in development research that modifies the research steps of Borg Gall. The method of data collection is through validation questionnaires filled out by experts using the Likert scale. While the calculation of the validity test uses Aikes's formula. Based on validation tests from material experts, linguists, media experts, and instrument experts, the BATURADEN word wall application-based assessment instrument is valid. Based on reliability tests conducted during small-scale tests, the BATURADEN word wall application-based assessment instrument was declared valid with a value of 0.758 which means it is reliable.

The Development of Teacher Performance Assessment Instruments in Boarding School

<p style="text-align: justify;">The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.</p>

Development of Assessment Instruments on Technology for Life Materials Based on Wordwall in Typhoon E-Book for Elementary School Students

The assessment process carried out in schools mostly still uses paper or paper tests, which require high printing costs and when checking the results of the assessment is quite time-consuming, sometimes there are errors in correcting. sometimes distracted by other activities as a teacher. The purpose of this research and development is to help overcome the above problems by developing an assessment instrument in the form of a word game that is certainly liked by children and facilitates the work of teachers. This development research uses the Thiargarajan method with the 4D method. Data collection from interviews, observations, and questionnaires. The results of product validation by a team of validators using Aiken's V formula are valid. Small-scale trials using student and teacher response questionnaires with very good results. In the large-scale trial, 30 students were sampled using Excel and SPSS with a mean N score of 0.8990. 0.7 and N-Percent 89.89% 76 which means valid and reliable.

Development of Wordwall-based Indonesian Geographical Condition Assessment Instrument in Modipaskogo E-Book for Elementary School Students

The ability to develop assessment instruments is an integral part of pedagogical skills that are needed by teachers to achieve optimal learning outcomes, the reality in the field is that the implementation of learning evaluation is still conventional with paper and pencil test instruments, has not utilized technology, especially in science learning Indonesian Geographical Conditions material in class V, lack of understanding or teacher trust in the use of alternative instruments that in accordance with the learning model developed, so that the learning outcome data obtained by class V students is not so optimal. As many as 65% of the number of students have not been able to achieve learning goals, besides that students look less motivated and not excited when working on learning evaluations. The purpose of this study is to develop a Wordwall-based assessment instrument in the Modipaskogo E-Book (Geographical Conditions IPAS Module). The method used in this study is the research and Development (RD) Model ADDIE (analysis, design, development, implementation, and evaluation). Based on data analysis and discussion, the conclusions of the Wordwall-Based Indonesian Geographical Conditions assessment instrument in the Modipaskogo E-Book are valid, reliable, very effective, and very practical to use.

Development of Electronic Portfolio Assessment Instruments to Improve Students’ Creative Thinking Skills in Chemical Reaction Equations Materials

Development of Electronic Portfolio Assessment Instruments to Improve Students’ Creative Thinking Skills in Chemical Reaction Equations Materials

An Integrated Research Framework: Advancing the Development and Validation of Decision-Making Skills Assessment Instrument in the Context of Asian Educators Abdulrahem, Linelyn/ Apostol, Elma/ Aguila, Mary Gay /Sapao, Alicia/ Vadil, Carlo

An Integrated Research Framework: Advancing the Development and Validation of Decision-Making Skills Assessment Instrument in the Context of Asian Educators Abdulrahem, Linelyn/ Apostol, Elma/ Aguila, Mary Gay /Sapao, Alicia/ Vadil, Carlo

Development and pilot testing of a maturity assessment instrument for testbeds in health care

High-quality testbed services play a key role in the development and testing of new innovations for health care. To ensure that the development and testing process is valid and reliable, the testbed itself should fulfil a certain maturity level. The objectives of this study were to develop and pilot a new maturity assessment instrument for health care testbeds and to assess the maturity level of participating testbeds using self-assessment auditing. The data were collected in 2022 from 11 health care testbeds in Finland using the developed Health Care Testbed Maturity Assessment (HCTM) instrument in the form of auditing. The data were analysed using descriptive statistical analysis. According to the study results, the average maturity level of the participating testbeds was 51%. The developed instrument indicated preliminary feasibility for assessing the maturity of health care testbeds. Further development and validation of the instrument are warranted.

Development of Literacy Aspects Class Minimum Competency Assessment Instruments With 21st Century Skills for Class VII Junior High School Students

Assessment is the process of collecting information about students (through various sources of evidence), regarding what they know and what they do. Efforts to improve the quality of learning can be achieved through improving the quality of the assessment system. The need for classroom AKM equipment for junior high schools is very large. Class AKM is related to measuring students' competence in thinking or reasoning in reading texts and solving problems that require literacy knowledge. The aim of this research is to analyze the development needs required in the AKM class instrument for literacy aspects through 21st century skills for junior high school students and develop an instrument design. The approach used in this research is a qualitative descriptive approach, with a research and development (R&D) approach. The data sources used were students and teachers at SMP Muhammadiyah 4 Semarang and SMP Negeri 37 Semarang. The results of the needs analysis according to the perception of students and teachers, the characteristics needed are a model for developing minimum competency assessment instruments for classes with literacy aspects with 21st century skills. In the model for developing minimum competency assessment instruments for classes with literacy aspects with 21st century skills, several Indonesian language learning materials are represented, namely materials fantasy story text with critical thinking aspects, poetry and gurindam pantun material with communication aspects, observation report material with creative thinking aspects, fiction and non-fiction story text material with collaboration aspects, and descriptive text material with critical thinking aspects. Keywords: Assessment, 21st Century Skills, Students, Teacher

Counselor Performance Test Instrument: Validity, Reliability, and Implications for Group Guidance Services

The development of counselor performance assessment instruments, especially for group guidance services, is still being developed independently by each higher education institution. It tends to be non-standard and not entirely in line with the need to create counselor competency in implementing school group guidance services. This research aims to create a performance test instrument for group guidance services for school counselors that is valid and reliable by adapting the development model from Borg & Gall at three stages of development. By involving 5 subjects as testers for the acceptability of performance instruments, namely 2 lecturers and 3 school counselors. Thirty-nine construct validity and reliability testing subjects consist of 2 lecturers, 12 school counselors, and 20 practical students. This development resulted in a set of counselor performance assessment instruments in group guidance services consisting of 13 statement instrument items on the planning aspect and 27 on the practice aspect, tested as valid and reliable based on SPSS 26 analysis. Furthermore, experts and users have also validated the assessment instrument by meeting acceptability criteria (applicable, feasible, and appropriate). Thus, it can be concluded that the counselor performance test instrument product in group guidance has met the development objectives and can be used for assessment in the planning and practice of group guidance services in schools or clinical counseling supervision activities.